largest ai model
Microsoft and Paige partner to create world's largest AI model for cancer detection: 'Unprecedented scale'
Thomas Fuchs, the Dean of Artificial Intelligence and Human Health at Mount Sinai in NYC, said AI will be needed to retain the standard of care in the U.S. Microsoft is partnering with the digital pathology company Paige to build the world's largest image-based artificial intelligence (AI) model to help detect cancer, the companies announced. The AI model will be used for digital pathology and oncology, configured with billions of parameters to provide a computer vision AI that is orders of magnitude larger than any similar model existing today. Dr. Thomas Fuchs, Paige's founder and chief scientist, told FOX News Digital that the amount of data used in the model is "orders of magnitude" larger than anything made public by Google or Facebook. "It's so much larger than anything that has been published in that area ever," he said. That scale is essential for patients.
- Health & Medicine > Therapeutic Area > Oncology (1.00)
- Health & Medicine > Diagnostic Medicine (1.00)
- Government > Regional Government > North America Government > United States Government > FDA (0.31)
- Information Technology > Communications > Social Media (0.47)
- Information Technology > Artificial Intelligence > Vision (0.37)
Last Week in AI #174: Cerebras sets record for largest AI model on one device, open source large language model, robotaxis paralyzed, and more!
Cerebras Systems, with its latest WSE-2 chip, has set the record for the largest AI model ever trained on a single device. The chip, which has 850k cores and 2.6 trillion transistors, is much larger than the largest GPUs. It has 123x more cores, 1k times more memory, and 12k times more bandwidth than the largest GPU. This allowed Cerebras to train a 20 billion parameter neural network model on a single chip. Doing so with GPUs would require complex compute cluster engineering and management, which could be much more expensive and only doable at large tech companies.
- Transportation > Ground > Road (1.00)
- Information Technology (1.00)
- Automobiles & Trucks (1.00)
US Hardware Startup, Cerebras, Sets Record For Largest AI Model Being Trained On One Device
When it comes to powerful chips, the US company Cerebras has you covered. They have trained their AI model on a single device powered by Wafer Scale Engine 2 – which is considered the world's largest chip in terms of processing power. According to the AI startup, A single CS-2 system may cut the engineering time and work required to train natural language processing (NLP) models from months to minutes. The branch of AI known as natural language processing (NLP) aims to make it possible for computers to analyze and comprehend human language from text or speech data. One of the "most unpleasant elements" of training big NLP models, which often entails distributing the model across hundreds or thousands of different GPUs, will be eliminated, according to Cerebras, as a result of its most recent finding.
Cerebras sets record for largest AI model on a single chip
In brief US hardware startup Cerebras claims to have trained the largest AI model on a single device powered by the world's largest Wafer Scale Engine 2 chip the size of a plate. "Using the Cerebras Software Platform (CSoft), our customers can easily train state-of-the-art GPT language models (such as GPT-3 and GPT-J) with up to 20 billion parameters on a single CS-2 system," the company claimed this week. "Running on a single CS-2, these models take minutes to set up and users can quickly move between models with just a few keystrokes." The CS-2 packs a whopping 850,000 cores, and has 40GB of on-chip memory capable of reaching 20 PB/sec memory bandwidth. The specs on other types of AI accelerators and GPUs pale in comparison, meaning machine learning engineers have to train huge AI models with billions of parameters across more servers.